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BETRACT 

Some problems in the optimum control of a linear dynamic 
system” are investigated, particuler]lyetme probler of ceter- 
mining the minimum time required to drive a linesr, ccnstant- 
coefficient dynamic system from an initial state to a specified 
terminal state with & limited power scurce. ihe important 
feature of the paper is that an elementary method of soluticn 
fcr this problem is given. It is a method of successive 
approximations based on the adjoint system of differential 
equaticns in a way similar to that which Bliss used in cal- 
culating differentials in Ballistics. A prcgram is given for 
Olving Themmanimum-Time problem on a digital computer; an 
elementary proof is given that if the routine converges then 
the solution thus founc yields the desired minimum time. 

ME orcind πεζστοπ.1ΞΕ sssumeo to πανε UENCE CO EEO TLS, 
representing limited driving power or voltage. This forcing 
vector is to be selected as a functicn of time sc as to drive 
the dynamic system from one state to another in minimum tine. 
In problems where certain control variables are bounded, it 
is well known that the control function assumes at all times 
either its maximum or its minimum value, changing cisccntinucus- 
ly from one to the other, This is generally the case here. 
The problems with this type cf control are frequently referred 
tc as Bang-Bang Control problems (13,(21,03]€. 

J. A system of differential equations will be considered as 
representing a dynamic system. 


2. References to the bibliography will be denoted by numbers 
in brackets [ |]. 





The solution cf the minimum-time problem for an N-th 
erpcer If¥mear, comstant=ccefficient systemyam waich the matrix 
of coeifi@ients has real end cistinct eigenvaitves, iswiven 
mM UU novation, including the setrof oiiferemivel-correcticn 
equations for cetermining the adjoint vectcr and minimum time 
associated with the desired terminal state. The soluticn of 
the adjoint system is given in terms of exponential functions 
of the eigenvalues of the matrix of coefficients and the 
corresponding eigenvectors (see Appendix I), the components of 
which are in the same ratio as the cofacters of the elements 
of & column of the corresponding characteristic matrix of the 
original system (see Appendix II). 

The general case cf the Second-order miniinm-tire problem 
wes programmed and run on the CDC-1604 computer. Because the 
convergence of the differential-correction eguations may be 
critical, especially for stable systems, a search routine was 
incorporated into the program to search the input-perameter 
space for "useable" sterting values. A second supplementary 
prcgram provices for the plctting of minimum-time trajectories” 
with initial state X(0) = O for any second-order systen. 

The general thirc-orcer minimum-time problem was also 
pregrammea and run cn the CDC-1604, using the general matrix 
techniques described for the N-th order system. Extension of 
the program to N-th crcer cculd be accomplished directly. 

1. A minimum-time trajectory is the locus of points in the 
state space through which the dynamic system passes as it is 


EU ven rom en initial Mate tce e terfiinsl state TA mi mun 
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A plot cf the minimum-time trajectories with initial 
etate X(O) = O for a particular stable system is included 
in illustration 2. This illustration also contains the 
switching curves associated with this initial state and 
the region of static stability. Switching curves do not 
seem to have a very general significance, i.e., they are 
not implicit in the differential equations but cepend on 
the initial conditions. It is to be noted however that 
for a seccnd-order dynamic system and those minimum-time 
trajectories with two switching times, the time between the 
switching times is an invariant of the dynamic system. 

The method of differential corrections for the adjoint 
system was first developed by Bliss for making differential 
corrections in Ballistics [8]. The set of differential- 
correction equations developed in this paper provide for 
the correcting of the input parameters to obtain the adjoint 
vector and minimum time associated with specified initial 
and terminal states. None of the papers reviewed on the 
Bang-Bang Control Problem provide such a system. 

I would like to express my gratitude fcr the encourage- 
ment, guidance, and inspiration which Professor Faulkner has 
provided, and without which this paper would not have been 
possible. 

1. A switching curve (surface) is the locus of points at 
which one of the components of the optimum forcing function 
changes sign. 

©. „A point of static stability of the system represented 
by A = AA+ F is a point such that an admissible force can 


be chosen to ccnstrain the system to that point. That is, it 
is a point where |£a,,x,| € 1, (1-1,2,...,n), and x, = 0, 


i 
απ) τον Some "admissible force F (see section 4). 
lv 
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l1. invecduevaon. 
του us consider e Linear dynamic system representec by 
the syetem of differenticl equations in matrix form 
(1) X(t) = AX(t) + F(t) 
or componentwise as 


ο kt) = à ay CO + fi(t) (1 رز‎ 52 


The natrix A is an n x n matrix with constant elements Ay 
Μ᾽... real, distinet eigenvalues, 

z(t) is enn x l matrix representing a point or a state 
of the dynamic system. No distinction will be mace generally 
between an n x 1 (column) matrix anc a vector. If a quantity 
ENNIO be ecnsiOercd as-e vector, ss in à scalar preduct, a 
bar (=) will be placed over it. 

ine dynamic system is centrollec by a limited power scurce, 
i.e., the components T; (t) of the vector forcing (control) 


function F(t) are restricted by the bounds 


[5) If, (t) | «ος ۔ ت‎ Lis dl eto 


[54 


where ihe Li are preassigned constants. The Li may all be 
assumed to be 1 (one) without loss of generality, and this 
will be the case henceforth. 

The principal preplem under investigation is the deter- 
mination of the mininum time requirec to drive the dynamic 
system from an initial state X(O) to a specified terminal 
state Ap, and the determination of the ccntrcl force F(t) 
which achieves this minimum time and the correspending path 


ere trajectory. 








The solution is effected by using the acjoint system 
of differential equations. Certain properties cf the ac joint 
system make this method well suited for the sclutaen of this 
prcblem. 

The adjoint system of differential equations is a 
homogenecus system; the system adjoint to (1) and (2) is 
formally defined by Bliss [9] as 

- اک‎ UMS ab UU) 
where the matrix A need not have constant elements. the 
superscript T denotes the transpcse of a matrix. 

Written componentwise, the system adjoint to (1) and (2) 
5 


(i5) u; (t) = = 2 ay Uy (t) (i = Joy e od). 


Whenever the elements of A are constent the hcmogeneous 
adjoint system can be solved directly in terms of exponential 
funetions of the eigenvalues of ihe matrix of coefficients,-A’, 
and the corresponding eigenvectors.! 

The fundamental 720300 formula [9] of Bliss“ 

(6) [Lux Ns : / 2 2 a,f,) at 
1 t4 i 
mows us, bY proper selection of «πο adjoint scluticons 
(choosing those soluticns of the adjoint system which meet 
specified end conditions), to express the terminal values 
of the sclutions of the original set of inhomogeneous equetions 
terms of integrals of ihe adjoint sclutions anc the forcing 


function of the dynamic system. 


l. see Appendix I. 
ο. See section 2 for derivation ané proof. 
e 





The order cf develcpment in this paper will be as 
follows: 

First, the adjoint system cf differential equatiens is 
Gefined, and the relation is established between scluticns 
of the original system of equations and its adjoint through 
Buc fundamental adjoint formula, a form of Green's Formula[11]. 

seccnads the mininum-time problem 185 solved by aprtiying 
bue forcing vector such that its prejection on a properly- 
enhcsen sdjoint vector is at all times a maximum. This 
prcperty is aisc known eas the Maximum Principle of Pontryagin. 
The solution requires the solution of a two-point bcunGary- 
value problem. The methoc employed is a method of successive 
Meorexametions, using the differential procedures which Bliss 
maurcdvceg in Ballistics, based on the adjoint system [8]. 
Eur, an elementary procf is given that @ scluticn so 
cotained furnishes the minimum time. 

Nros. an example is given of the Sselimacn of a srecitic 
Beccnd-crder system through the use of the adicint system of 
differential equations. 

Fourth, the solution of the general N-th order prcblem 
is Cerivec in matrix nctaticn for the case of a linear, constant- 
Æ icient system of differential equations where the matrix 


e 


9 coefficients has real and distinct eigenvalues. This 
E ices the differential-correction equations fcr determining 
Mie ac joint vector end the minimum time associated with a 


ereciliec terminal state. 





Firth, the techniques described abeve are applied in 
thewprogramming ef a digital computer of the solution of the 
Ainimun-time problem for general seccnd- and third-order 


systems. 





- Πολλα ς των Systek cf Vifferentiad Equatitns, Green's Formula, 
Let us consider a system of linesr differential equeticns 
Mr Lten "n matrix form es 
me x =k + F 


۰۰٠٠۹770 ۱60710186 ٤ 


v A. = 3 a + f (i l,29 55932) 
where the elements 4,, cf μου ην A areiceastents (cr conti tous 
functicas of t), end where f, zre functicns cf t [92]. 
Mepiviticn? 


E 
f 


equaticns adjcint tc (1) and (2) 


inte 
اسا‎ 
iy 
(iy 
tg 
C 
ES 
E 
com 
e 
0 
| 


ine systen cf c 


no 
Co 
δ.“ 
Cte 

It 

i 
Ἢ 
Ci 


Yos S, : ine “ 
k iol κ CT = Ια... 


Theorem (Funiesientel Acjcint Fermule) [2]: 


ENS x - 2, TER MP 
K 
E vv, == ) ayer en 


Mere (4) is the adjcint of (2), 


mien (5) d - 
E Eux = uno: 


5 
4 
at. 


Ubis rvst hcló for every soluticn of (9) 


د2 
ہم 
a‏ 
H‏ 
~ 
e‏ 


tel 


0) 
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Censicer the Lerrange Icentity ΠΠ 


(6) Ω o 9 
FE ہے‎ ( IN en ) مس‎ 5 + 
C | d T 2 (Ua Xs U¿X;) 





Substituting (2) and (4) into (6) we get 


(7) 


lo. 


e SE 
» وگ تا‎ - vs ( er a. * Γι) ES E Aa, ° 
IR al DE i | ο προ 


کے 
er‏ 


Expancing (7) we get 


M jie Ww said 
οτί اع = ( کرت به‎ κα κ 090 بے‎ ο. ert 


pa, incterchenging the meaning cf i anc k in the last term, 


(9) CE ux) c L Lay QA tL 


ele. 
e 


1 a 


τ 
f. - ات می‎ 
: ο 
ah 20  - 0 
which upon interchanging the order of summaticn in the last 
term peccmes 


E. E A 
Rb us μάς 2 ajn UX, + 37 تپ‎ 


ede. 


Ez‏ اج 
a, UK, o‏ 


pep) 


K 
Hence we get the final result, the Fundamental Adjcint Formula 


ES Bliss [9]: 


Dp (Fux) = pu 


: 700 0 
di 


Alternatively, the Fundamental Adjoint Fcrmula can be 


Written in integral form es 
, to iz 
m L = VES ۳ = f ( 3 MEE Gut 9 
9 1 9 3 1 
T t 1 


This form is cften referred to as Green's Formule [11]. 





ο. Gmc lanewet Solution, treliminamy Formulas, 
Let us New censider the system cf qifferential equaticns 
discussecó in secticn 1 
(1) X(t) = AX(t) + F(t). 


+9۹۵ 


e 


fe this paper the dimension of F(t) is the same es th 
Eee, theugh this is irrelevant to the method cf soluticn, 

Given an initial state Z(O) of the dynamic system and 
anevher state ho (referred to as the terminal state), we 
desire to determine how to drive the system from X(0) to Kp 
υπο tame by proper appliceticn of the control fcrce 
F(t). 

Ihe scluticn cf the mininumetime problem consists 
basically of tne fcllowing steps: 

&. Equaticrs are obtained from Green's Formula! 2 
tc express the terminal values of the system state variebles 
σσ of the initial state values, the time, and an 
EN -:ral invclving the fcrcing functicn F(t) enàó the sclutions 
SS lhe adjoint system. 

mee IL is established next that if a soluticn is obtainec 
which meximizes e certain integral and satisfies the desired 
Es cconoitions it is the desirec scluticn. 

e. Only solutions are scught which maximize an integral 
of this form. However, there are scme perameters in the 
integral, and these must be cetermined so as te yield the 
E Bquaticns from other secticns will be denoted by decimal 
numbers; the number preceding the decimal point indicates 


Me” section, and the number fcllowing indicates the equeticn 
mier in thet section. 





desired end conditicns. Ihe prcblem reduces to the sclvtiocon 
Gone twoepcint bewndary-value prcblem. 

As prcblem is solve by 9o methcc of successive 
πάση ihe ccrrecticns tc the input parameters 
۰۰۲۱۱۰0166 by a method besec on Bliss’ method of computing 
ms erentials in Ballistics. 

DeSoer [2] proves the existence of a minimun-time path 
for stable systems. 

The solution of the adjoint system obtained in the 
Process defines the funceticnsel for the Maximum Principle of 
E oUssin [7]. The integrand cf the functionel is the 
Peeler product ci the forcing vector end a vector defined 


Ene soluticn of the adjcint system of differential equaticns. 


we therefore have unaer investigaticn the cynzide system 


governec by the system cf cifferential equations 


Zo — AS t FE‏ رت3 


une system adjoint to (1) can be written directly as 


E 
(2) U = = A IJ 
Frem the Fundamental Adjoint Formula (Green's Formula) 


Beeect, checsing t, = O, t> = T, 
T qu 
© i EET J, "x CAL ο ου 


ο 
Let us nov examine the solutions of the hcmogeneous 


En int system., Fron Appendix I we see that (fcr n distinct 


m 
9 » 2 OUO o e 
eicenvalves “10s O Mauri A) Meretare mn 0lstinct soluticas 


io) 


U^ cf the ¿djcint system cf the fcri: 


U = فى ازم‎ (jee 





3 ΓΙ 
9 . AL 9 a 
where CJ is the eigenvector Le}; Cos ٣ BE coda ted 
J ej N) 


e e j j ] j JE 
with eigenvelue E Ud = [vi u) αν |; 
Since the scluticns U? are independent soluticns of 
Aer 2d joint system, it follows thet the general scluticn 
cf the adjoint system cen be written as a linear ccmbination 
of the u, πο, 


DD U= Σ, κ. yA where the z are arbitrary constants. 
J 


EN Ututing (4) into (5) results in 


(6) U = Σ κ و کرس‎ 


Suppose we new select a set of "Special" adjoint 


1 ۱ η 
LU. s aos 949909 Un 5 9 ( j = ο eng) 


N 


ersticns U: 


vhich meet the ud end conditions: 
(7) ui4(1) - = EC A μή, | 
Wwe see then that the terminal values x; (T) cf the 
scluticns cf the criginal system cf equeticns can be deter- 
Minee by cuccessively substituting the "special" sclutions 
ef the adjcint system into the fundamental formula (3). 


Phat is, substituting in Us in (3); we get 
I 1 
© ΓΣυρι1ς -[ (Συια οἱ 
which, since u. UD = l, ui (T) = 0, i#j, reduces to 


Σ f j 
(2) κια) =È uy (0), (0) f ( کر ند لے‎ (05 (j21,2,...,n). 
O 





If we consicer E ac 2 vector in e cartesian coordinste 
set with base vectors €j, then 


(10) U, E 2 üj ji" 


If we also define a vector D the system state vcctor, by 


the equation 


a) x = "Rem 
1 
then equation (©) can be written as 
ugs 
d2 xD = مترق‎ (Met him. 
0 


Since the U, are independent scluticns of the edjcint 
J 
system a linear ccmbinaticn cf the U, IS ALO CG «ον Ιση, 


EE U= Uy + bUg ؛)‎ ۰ ۰ +,+ b, QU. 


where the b. are arbitrary constants. 


A scluticn U cefined in thie way is called an adjcint 


vector, 


From (12) we have the follcwing equaticns, cbtained by 


successively substituting in the U. into (3): 


i 


«f OTT) GG‏ 0 ,0( = رت 
O‏ 
DET‏ 1 پر ے 
πα αν‏ | تق = κο)‏ 
O‏ 
Ea)‏ 
IM jM‏ 
x,C) - (0.5, «f (U.F) at‏ 
O‏ 


10 





EE o ο desr cembineticn of the above, using 


say the Ds of (13), we get 


T 
® x CN) ۴ Bixo (P) 000 ۳ του = ΛΝ ο τας 


Equations (14) and (15) are the fundamental equations 
mere tune scluticn of the problem. 

We shall hereafter ccnsider cnly forcing vectors F such 
that the scaler product (U.F) is a maximum. In the next 


Peericns it will be seen how this characterizes the soluticns. 


11 





4, A Theorem on Minimum Time. 

In this section it will be shown that if an admissible 
trajectory can be found which satisfies a maximizing principle, 
then, at least under the conditions given below, it furnishes 
the desired minimum time. 

An admissible trajectory is one which has the specified 
initial and terminal points; with it must be associated an 
Bumissible forcing function. An admissible forcing function F 
is one which satisfies the constraints on its components, 
ات‎ Eu In this section no Specific assumptions are made 
regarding the eigenvalues of the matrix A in the system of 
differential equaticns 

(1) Χ = AX + Ε 
but À is assumed to be a constant matrix. 

A point of static stability of (1) is a point such that 
an admissible fcrce can be chosen to constrain the system to 
Smee point. That is, it is a point where | 2, a4 4X4 eu. 

BN- 1,2,...,n), and x, = 0, (i = Po. OSE: some admis- 


ab 


sible F. A point such that | NOE 


ren 
is a vertex point of the points of static stability. 
Now suppose we have in some way found a path cu and a 

vector U' which together satisfy the following relations: 

ESI. The path C' is admissible for some value of T, say T 

fee. Û = U, QU, 4 ....4 b, ,1U, is a solution to the 
adjoint system of differential equations. The U. are the 
"special" solutions defined earlier, and the b's are known 


Berstants, 
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H.3. For each value of t, the force F' associated with C* 
is such that the scalar product (5.2) is a maximum. 
H.4. Each component TM dad ος U” vanishes 


at most at isolated points in ο ώς 


Theorem, The trajectory C which satisfies H.1, H.2, Hud, 
and H.4 yields the minimum time T" and is unique, comparec 
with all paths which contain a point of static stability 


that is not a vertex point. 


Procf. Consider equation (3.15) with the values b;,....5bq 4 


from H.2 for any admissible trajectory for time q”. 


+ 


T 
af = e^ ہے کت‎ 
A A SSP -— (0. has. 


We shall see that F' maximizes this and then as a consequence 
Tt is minimal. Note that every term on the left side of (2) 
is determined by the specified conditions Ao, Χρ and the 
quantities by,..-+,D,_49 e 


Now consider the force F' above and any other force F 


; + 
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admissible path for that value T" of T. 

There might conceivably be, however, a path C" with a 
smaller value Pa of T. assume this to be the case and assume 
that there is a point X, of static stability on Gl. 

Let T'- T. - AT, and let t, be the time associated with X, 
En C", 
The force function F' constructed as follows then will 


4- 
lead to an admissible trajectory C' with T - T : 


it 
(1i (t) ο τς ts 
t = =- Xi 
f: = , 81 4X3s Lao E < t t21 
| f'(t-AT) +۵" > ٠ < و‎ 


The middle segment of C' constrains X to X. for an 
interval of length AT, and the two end segments then lead 


from Ag to Ae and from X. to Apo 
Now note that 
+ t _ +AT 
1 =+ „=+ = D =+ =+ m 
(4) | [U*.(F^- F')] at > | 0+0 + + + + + 1 + + +0 
O 
ic 


Ce 


and, for at least one value of i, 
De FAT 
(5) ^ (st 2 tty ut > ο 
inea 


ts 


9 





+ _ ο... 4 
Since u, has only isolated zeros end (f;- fi)u. - (1 4 fs) lu, 


But C' is the only admissible path associated with 
time T". There is then a contradiction. It arises from the 
assumpticn that a second path with T < T existed. This 
completes the proof: if such a path is found, it defines 


the soluticn and is unique. 
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Clearly the sproef holdseif in H.3% (F'.U*) is a minimum 


i 4 
matcher than a maximum on C . 


Bemollary. if the matrix A has real distinct eigenvalues, 
if either xg or Χρ is a point of static stability whichis 
not a vertex point, and if a curve añ and an adjoint vector 
have been found which satisfy H.1, 1.2, H.3 with none of 
ο. ٦٦۶۹۸۷۶ H.2 zero, then C^ defines the minimum value of 1 
and is unique. 

In this case every trajectory contains a point of static 


stability Xo or Xe which is not a vertex point. Every u 


has the form 11 E L8 ej" with at least one se 
distinct from zero for each value of i. It has at most 
n-l zeros, and U' satisfies H.4. All of the hypotheses of 
the tneorem are satisfied by pur 

If the values of bi,...., D, 4, T" were known, it would 
be just a matter of integration tc get the trajectory by 
setting fi = sgn ure In the next sections these will be 
determined by a method of successive approximaticns. 


The proof of the theorem in this section is due to 


Professor Faulkner. 


€ € n Å- 
pe -— © ~~, = 

9 m ٢ 
a © 


BI > 





5. Example of a Specific Second-Order Problem and Colution. 
In this section the sclution of the minimum-time problem 
for a specific secona-oraer stable system will be worked out 
no tule deta... Me Solution conSists basically of tne*fol- 
lowing steps: 

a. The aajoint system of differential equations is solved. 
b. A set of input parameters (1,b) is selected, and a set 
a special" «uajoint solutions (with the corresponding adjoint 

vector) is determined. 

Co The terminal vaiues x(1), y(7) of tne Gynamic system 
are expressea as integrals involving the "Special" adjoint 
Petitions and thé vector forcing function, and a trajectory 
is determined by the Maximum Frinciple. 

d. The resulting terminal state (x(T),y(T)) is compared 
with the required terminal state (Xp Ve), and the changes in 
T and b required to effect ہہ‎ are determined from a set 


of differential-correction equations. 


The dynamic system which will be considered is governed 


by the pair of linear first-order differential equations 


[x = -x+ yet ESI 
(1) 5 
Jy = -2χ- Αγ 4 ϱ lel € 1. 
Ihe system of differential equations adjoint to (1) 
can be written directly as 
= u + ον 


(2) 


V = =0 + 4y 
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The characteristic equaticn of matrix A is 
-l-m J 
(3) zo 
-2  -4-m 

Ihe eigenvalues of À, roots of (3), are m= -2,-3. 
Now, if m,, m, are eigenvalues of matrix A, then -m,;,-ms 
are eigenvalues of بے‎ 

Tence ef", e°" and ths eigenvalues of ŽA! will define 
a fundamental set of solutions of the adjoint system (2). 


Denote these solutions by Uł, U? where 


(4) Ὁ; = ji" We = p 
Lv? ] Lv? 


From Appendix I we know that for each distinct eigen- 
value of E the corresponding solution of the adjoint 
system can be written in the form 

E u = eTit ol 
where “i; is an eigenvalue of ais and c? is the corresponding 
eigenvector. 

mince the eigenvalues are real and distinct, we know 
(see Appendix II) that the components of ci are in the same 
ratio as the cofactors of the elements of a column of the 


characteristic matrix [A - m1]. We can therefore determine 


that 
— UG W 
οι | 2 | on E | 
Then the solutions U!, U* of the adjoint system are 
(7) ut = eMitci = اگم‎ 


2] 
| 
τ 


po 
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and 


«U^ = ο ποῦ ο - ο Γ 


3 
m 
5و‎ 
Since Ui, UF comprise a fundamental set for the adjoint 


Elen (2), U = kU? + kU? is also a solution, i.e., 


(9) 0 SN + 2 E 


jf kje? 
3t 
|kge | 


= 


0 2 


1 
f | 
[1j D 





Ἢ 
where the k's are arbitrary constants. 


We will denote the matrix of eigenvectors of zs by C, 


where 
O) c = [c ο] = [2 " 
0۰ 
Inverting C we get x. κ. =l 7 
| | 
ii ij 
A J 


Let us now return to the original set of differential 
equations (1) which we may write as 
x+ Xe y =f = 0 
EI (C. 
y t 2x * Ay -g = ο 
Suppose we now multiply the first equation cf (11) 
by u and the second by v, where u,v are required only to 
memwecontinuous functicns of t which have continuous first 


Cerivatives. Adding the two products and integrating the 


sum from O to T, we get [4] 
Ilo) | [u(x* x-y -f) + ví(y + 2x + 4y - g)jdt = O 
4 Q 
Note that if x,y are solutions of the original set of equations, 
then u,v used in this way are called Lagrenge multipliers. 


i8 





Integrating (12) by parts we get 


T T ; 3 
(13) [ux * uj. +f [x(-u + u + 2v) + y(-v - u + 4v) àt 
DEG 


T 
-f (ut 4+ eve ۰ ۸ 
ο 


If we now choose u,v as solutions of the adjoint system, 


we have 
-u 1 cv ο 
(14) - 
-y =» u + 4V = O 


If u,v are thus chosen, (13) reduces to 


] ] 


Note that (15) is a particular example of the Fundamental 


Adjoint Formula of section 2. 


ouppose we now choose a set of "special" solutions of 


the adjoint system as follows: 


(16) U, = Puy gach that ο ο) =1 
۷)۶ ٦ 

and 
(17) U = [uz] such that uz(T) = 0 
IM Vo(l) = 1 


Substituting U, into (9) we get, evaluating at t - T 
Q8) UG) = [fu (D) = [2 ھ22‎ 7٣۲ 

| | 
men! د‎ α][κοιοῦτ] | ο 


Este: The second subscripts of k44, ko, indicate that they 





Κοιθ 


Borrespond to the first solution U,;. 







$ - 
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یس‎ s 
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baee ων A 
E E cU. 
a «αἲ ^ Ww 
۰ت‎ po dl ο Hi i 
١آ‎ s^ 
-. αμα -ι- ™ 


TES 


= 2 
τ. 


























Multiplying (18) through by ο we get 


ES ikye | = cf 1 ol 7} 
net ro | 621 (71/2. 
where the cis are elements of c+. 
Therefore ky, = a 
' ΝΞ وڈ‎ 
=2 
Then 


¿21 t-1) 


2 | 
21 e3 (8-7) 
E 3 


(20) fui()! =[ 2 
i ; 1 





Similarly, substituting U, into (9), we determine that 


bus ven. age 
Kee = e^?i 
so that 
(22) a(t) - [2 2 [ 22-7) 
wa (t) | l1 2: e3(t-T) 


Substituting U4 into (15),we get 


Tu 
(23s)  x(T) s uQ(0)x(O) * v41(0)y(0O) + | [uif * vi,glàt. 
4 O 


«αὶ 


Substituting Ug into (15), we get 
"T 
(24) y(T) = us (0)x(0) * νο(ο)γ(ο) + Ea + Veg ldt. 
ο 


Let us now consider the "special" adjoint solutions 
as vector functions 


(25) ΠΗ Ξ Dre, + στε, 


Ug = Uzey 5 ὕρθρ 
where €, ©, are the base vectors for a cartesian coordinate 


set in two dimensions. 
20 





Since U, and Uz are independent solutions of the adjcint 
system, a linear combination of these is also a solution, i.e., 


(27) U m ja 4 υπ 


(u, * bug)e, * (v, + bV2)ez 
S ue, Me, 

Combining (23) and (24) in the same linear combination, we 
obtain 

(28)  x(T) * b y(T) = (us+buzg)_x(0) + (v,+bv2),y(0) 

T 
Yi ۱ [(u,+bus)f£ + (v,+bve)Je Jat. 
which can be written as 


5)... χίΤ) + DAY ET) 


H 


- 1 
u(0)x(0) + v(O)y(0) +/ [uf + ٣۶7 
ESO 


Defining vector IM Xe, T VENT we can rewrite (29) as 


(U.R). + |}  (U.F)at. 
© |o 


(30) x(T) * b y(T) 


where F = f e, + g e e 


Suppose now that we desire to drive the system from 
SO) y (0)) to (Xe, Ye) in minimum time. As we have seen 
earlier (section 4), this may be accomplished by applying 
Pontryagin's Maximum Principle to (30), i.e., by choosing 
the vector F - F such that the projection of F' on the 
adjoint vector U is at all times a maximum. That is, 
we choose F' such that its components satisfy the following 


relations: 


N 


κε) 
(31) f 


sgn u 


+ 
g = sgn Vo 
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> ο. 


a= adi n rer 
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ae. De 
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Equation (30) then can be rewritten as 
I m eR fe 
(32) x(T) *b y(T) - QR! Pdt 


Mile (23) can be rewritten as 


(83) x(T) - ἄν %1  (U,.F at , 
42 ο 


end (24) can be rewritten as 
T 


{ 


(34) y(T) = (UR) -| (U..F)at. 
“ο 


However, the value of T which we have selected is only 
a "guess" at the actual minimum time required to drive the 
system to (Kase), and the constant b is only a "guess" for 
the linear combination of Uz,U2z to determine the proper 
adjoint vector associated with the desired terminal state. 
We must therefore compare the resulting state (x(T),y(T)) 
with the desired terminal state (Ae Ye) to determine the 
errors 
(35) f Xp - x(T) 
| 8۳3ھ“‎ ۶ ۳۵ 


AX 


and determine the changes £T, 6b required in the input 
parameters to drive the system to the desired terminal state. 
For this we will derive a set of equations to determine 
ó T, Sb. Suppose we replace T and b by nearby values 
(36) T <s T+ oT 
i - b* ób 





IND 
N 





Now, writing x(T) = x(T,b) and y(T) = y(T,b) since the 


terminal values are implicit functions of b, we get 


(37) [ x(T,b) ———> x(T+ 5T,b+ 5b) = x(T,b) + óX 
pius terms’ of higher order. 


Now 


Ho 


(38) ÒX DA cm DA 
aT ol + SD ób 


ΙΙ» 


ΦΥ ex ðY 
3T áT + a 6b 


where óX, óY denote the total differentials of x(T,b) 


and y(T,b) respectively, i.e., 


aa - 2% a _ ok 
ép X0) 7 op X(T) = ap 

(39) i 
oY 
SEID = $T 0 +0 ον 


we can rewrite (38) as a single matrix equation 


(40) - a SAPE: Ξ te 
aY!| Sb ὁδὶ 


770 db, 


where € is the matrix defined in (40). This matrix is 
ped the "correcticn" matrix. 
Multiplying (40) through by E and setting 8۶× = AX 
ENS OY = AY, we get 
7 | 
(41) = pe = : کت و‎ 


6b 6Y 212ھ٤٢‎ 


— 


— 





Equation (41) will be referred to as the "correction equaticn, 


Bo 
Go 


cm ور وا‎ io n 
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Hence we have determined the changes óT, ób in the 
input parameters required to drive the system to (Ap Vp), SO 


that 


[| 


(42) ( x(T * óT, b * ób) - X, 
i οι, ο +t ób) Y. 


except for higher-order terms. 
Therefore we have solved the minimum-time problem 
assuming we can determine the elements of the "correction" 


matrix, and if the routine ccnverges. 


We will first determine 8X . 
oT 


1 - 
where X 2 x(T) - (U.R), + / (0,.F*)at. 
ο 


On a minimum-time trajectory each component of a 
two-Gimensional forcing vector will switch (change sign) 
at most one time if the eigenvalues are real. These 
switching times are defined by the equations 


Et.) 
(43) { 


u) = ο, g switches from +1 to ie = Coe 


Oe; f swatches from tle tout! at t = ty. 


Order tis To as Er ο «κ < K < e 
est ine | 0 = to κ-ο 


i 
N 
il 


IT = tka K 


με OS k<s<K< 2, 
With the above notation, we can express (33) as 


= m K t 
NA ik), a ο 
k=0 


(Un FE ) (b 
Ἐς 
where the integrand is ccntinuous over each subinterval 


ery integraticn t, to t 


] k+] ° 


ca 





To simplify notation we will make the following 


definition: 
cn 
(45) li at (Us QE ) ^ ty < ¥ < و‎ 
Tên (44) can be rewritten as 
_ K Eu 
(46) X = ٔ ٔ 0 m rj I, ας, 
E O ti 


Applying Leibniz' Rule for the differentiation of a definite 
integral the limits of which are functions of a parameter L5], 


we obtain 


. t 
- k+1 K 
er) m. Ale τ. 
eT ^ (ap P9 * OD dk ap * 7 0 
0 E öl O $T. 


8 
GO [E 


τε ος 

I E ATA 

er if [ J, denotes the discontinuity (jump) in a functicn 
k 

at point ty, we can write (47) as 

A, 


eX _ (8Ui au, 2+ πο δν 
ο - (951,8) +f (hs Pat + (0,.F) 


(48) 


οὗ το 1, or 2. 
Now, for fixed b, it is readily seen that $t 
ATA - l, so 


so that (48) reduces to 


ہت -- E) 6x ο - 1 οὗ.‏ 
Qu.‏ + ور سی ار رد ری - $$ 
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ale‏ ےی 


۲ وا سے o‏ 
۱ ہے 
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Similarly, 


ΓΤι 


۱ 1 
(50) ὃν _ (QU da p* کر ےم‎ 
ος سر علق ۔‎ jJ Alerta + (Ua.F Dy 
i » ΙΙ 
1 κ 


By the same methods we can determine that ox and ðY 
ab ob 


can be expressed as 
K 


Sl) 8k = -) (vAr at 
ch k=0 1 = کے‎ 
and 
Kel 
652) OMM ۳ fw 
۔‎ 2 (Us LF De d ον η 
i ~ eb 
1ο completely determine 2 end ος we must determine 0021 
ob 


These can be determined by making the following linear 
approximation of the change in the switching times, denoted 


by Ot, (and Oto): 




















E - A MMC = = 1 (€U se Qu 
(53) Ot, = ou = | : (om ot + E 95) 
u τι 
and since u = u(T-t), it follows that u=- En 
so that (53) reduces to 
au 
(54 6t, = ór - طقف‎ ἕο = ÔT -| óp 
u ti t; 
so that 
655) Ot, - _ Mo 
ob u La 
Similarly, 
(56) Qty. _ Ve 
ab 
V Lo 








Having determined 0t, 41 we can now write the final 





ob 
expressions cf 0^ and aY as 
eb ob 
e X 
X | 4 | لا‎ 
ᾱ ob +۹ σα τ MU ] ΕΣ | 
| ù ty L 
and 


Γ 
| 


(E) 9X . . «ην 4 vale AE - | 
| u τ | V 2j 


we have now determined all the elements of the "correction" 


€» 





matrix, so that the minimum-time problem is solved, if the 
routine converges. 

In this section we have developed the solution of the 
ninimum-time problem for a specific second-order system. However, 
each step of the solution has been derived in general notation 
before substituting in the numerical values. It is therefore 
unnecessary to repeat the development for the general case for 
second-order systems. In the succeeding sections, the solution 
of the problem for the general case will be developed for 
higher-order systems. 

An interesting property of second-order systems was 
discovered; it is the followings If a minimum-time trajectory 
for second-order systems has two switching times, the time 
between these switching times is an invariant of the dynamic 
system. An elementary proof of this result is given in 


section 8. 


2? 





6. Derivation of Soluticn for Third-Order System. 

Suppose we have a set of three inhomogenecus linear 
first-order differential equations with constant coefficients 
representing a dynamic system 

O Ax a Ε 
where X = [x, xg xg], F = [fı fe fs], and Ais a 3 x3 
matrix with constant elements aiye The eigenvalues of A 


are assumed to be real and distinct. 


The characteristic equaticn associated with matrix Α 


15 
(2) E oj 0 
Mal». 
(3) a31-m  asz2 818 
az Age-M ^ agg = Ou 
231 232 agg-In 


which, when expanded by determinants, becomes a cubic 
equation in m of the form 
(4) m? 4 bam? + bəm + ba = O. 

Denote by My, Mg, Mg the roots of (4), i.e., the eigenvalues 
of matrix A. 

Then  -m4,, -ma, -ma are eigenvalues of M 

Therefore, if we consider the system adjoint to (1), 
which is 


(5) ای‎ where U = [uy us M 


then B ms m ea’ ana the eigenvectors of -AT will 


define a fundamental set of solutions of the adjoint system. 


N 
00 





Let us consider the solution of the adjoint system (5) 


in terms of the eigenvectors of the matrix of coefficients, =A. 


4e have 

E an. 
Assume a solution of the form 

ο U = etc! where C'= [οι ες» ۲ is a constant 
vector. 


Differentiating (6) with respect to t, we obtain 
(7) U ام اک ہے‎ 
me stitution of (7) and (6) back into (5) gives 


το 


and since e is a scalar quantity appearing on both sides 


of the equation, it follows that 


© τος -A7 c. 


τετ, "6 Choose ۴.5 2۰ 30" /٣ ahs of τ. 
then C'is by definition the corresponding eigenvector. Hence, 
for each eigenvalue of E we have a unique solution of the 


adjoint system if the eigenvalues are distinct. Therefore, 


we have the following fundamental set of solutions of (5): 


ΠΕΝ. -. سی‎ ca 
U? = e Mat ga 
کا‎ "s" cs 


Tien any linear combinaticn of U?, U?, U? is also a solution 
EIU - ke 1d 1 +use Tel ce Pre mat cs 
mere the k's are arbitrary constants. If (10) is written 


in expanded form, we get 


=M; t =Mo T =m - 
(11) U = kye !'[eii| + kee?” feaz) + kge st | Cis] 
C21 C22] | Cog 
231 Caz | m 


B 





Equation (11) can then be expressed as the product of 


two matrices, as follows: 


i = =m; t 

us C41 Cie Cig k,e + 
=!c C -m 
Ue 21 C22 23 koe 2 


u C31 Case C33 
3 -Mgt 
49 
where C114 C42 C33 
C = |C21 C22 Ce 


C31 C32 C33 
is the matrix of eigenvectors of -— 
Then, the general solution of the adjoint system 


can be written as 


| Uy | ο ους 

ua) us] = C kse Tat 
ug dli 

καθ mat 


We will now chocse a "special"solution U, - [u;4 ug, E 
such that u,,(T) = 1, Uaı(T) = O, ug,(7) 2» O. Substitution 


EN. into (12) evaluated at t = T gives us 





Γ -mT 
u4 4 (T) | δαν T ES 
ee) Uil) = C | Kage 5- O 
us4 (T) | | kg1e 8 ο) 


where the second subscripts of the k's indicate constants 
corresponding to solution U;, 


Multiplying (13) through by C”* we get 


Feen" 1 C11 

aa) xewemMel S er = 68 
=Ma T 

C41‏ 0 3 ا 


where the ci; are elements of c^, 


l. See Appendix II for determinaticn of compcnents of c? 


in terms of cofactors of [A - mI]. 


G3 
© 





Then 


_ | m41 
a ' K11 = Cia e T 
5 x Mol 
Ko, = Cg, € τ 
E i Mg 
Kg1 Ξ οι ϐ 


Substitution of (15) back into (12) gives 


u Ket C13 un 

11 E ۱ mod 

(16) 2 = cue met zm eom a : 
E kaye mat C31 e 38°" 


Similarly, we can choose a second "special" solution 
“۷ ) Usa uas]? of the adjoint system satisfying the 
end conditions wuye(T) = 0, Uee(T) = 1, Uge(T) = 0, which 


results in 


8 و‎ ea (T-t) 
12 o 1 mo (T-t) 

(17) [|Uzge| = C Con € 
Uge C32 oMa (T-t) 


and, choosing a third "special" adjoint solution 
DI, = [uiz U23 D satisfying the end conditions 


ECT = O, Ueg(T) = O, Usa(1) = 1, we obtain 
5 Ἢ mı (T-t) 


Doe Ci3 € 
ele ) uss = C Cos eig (T- t) 
1183 cm elis CT- t) 
If we group (16), (17), and (18) into a single matrix 


equation, we obtain 


Uri Use U13 d elis CES) ےت‎ All) el ¿em >> >5 ٦ 
(19) |Uz1 Uzz Uga| = C et ¿ez (1-8) AO et gema (1-4) 
Ugi U32 U33 ches (T-t) رح‎ (T7 0) c5 ea (1-0) 
¿My (Tot) 0 0 
(20) fo =" c 0 eI ey 0 c^t 
(21) [U] =cEc™ 


where E is the diagonal matrix with ےت‎ element ¿My (Lt) 


IU = [U, Us Us]. 
31 





Since U,, Us, Ug are solutions of the adjoint system 
then any linear combination of these is also a solution: 
(22) U = Ui + bıUa یع‎ Όρια 


where U - [ua Us us]; 


mess; | Ul = Uri + b4U32 * bguss 
Us = Usy + DyUee + Degg 


Ug = Usı + DyUge + Degg, 


Written in matrix form, the above set of equations becomes 


ہے 


"d U11 U12 U18 || 4 
(Z3) |U2 = |Uzgz Uzz Ueg|| Di: 
5 | 
لوڈ‎ | Ug1 Us2 Uss|| De | 


i >1. 


Let es, 62, eg represent the base vectors of a three- 
dimensional cartesian coordinate system. we can then 


express U,, Us, Ug as the vectors 


Uy, = Uyıeı + Unies + روتا‎ 69 
(24) Ug = Uacı + Ugaez2 + Ugseg 
Ug = Uygey + Uzglz + Ugzez 


Then U = U, + b,Ua + b2aUg can be written as 

(25) Ὁ - (uj4* biuig* bauig)e, * (ugi* bíuga * bauzs)es 

+ (Usıt bıUga + bauga)ez 

which can also be written as 

>) U = we + کے ےت‎ 
A solution U obtained in this way is called an adjoint 
vector. 

If in the Fundamental Adjoint Formula we let t, = O 


and ts = T, we have, from (2.11), 


T T 
(27) Ll ul, - | ( 2, u, f, )dt. 


O T 


óc 





If we desire to determine x,Q), we chocse the adjoint 


selution U = Us: This reduces (27) to 


E T 
(28) x= (Eu, + jp (Lut)  Gn23 


which can be written in equivalent vector notaticn as 
. me 
(29) x(t) ی٦‎ + | (5, Flat, (3=1,2,3), 
O 


where X - X,064, * X505 * Xg93. 


we wish to drive the system from state X(0) to Xe in 
minimum time T. We therefore consider a linear combination 
of the x40), using say the constants b. of (22). we get 
(30)  x4(T) + bixa(T) + boxa(T) = [(Us + b1U2 + Ὀρῦα).Χ], ᾿ 


ads 7 = E 
«f ο + bau 4 boUs).R idt, 
O 


which can be written as 


T 
fem) αι) + baxo (1) + Dax (1) E ees [ (U.F)at. 


O 
Applying Pontryagin's Maximum Principle, i.e., by chocsing 


F = F such that a = sgn U,, We obtain 


ae T مو‎ 
nus (ot ο ο ο πο + T (U.F^)at 
ο 
We now compare the resulting terminal state X(T) with 


the desired terminal state Ap» and define the component errors 


as 
DEL UD X; 
(33) { Χορ - xa(1) - AX? 
| har IDS “Axe, 


29 





If any AX. (j = 1,2,3) is not zero, we must determine 


J 
the changes óT, Ób,, Ob. in the input parameters required 
tc effect Ag: Buppose the initial input parameters are 


replaced by nearby Values 











JE -> T + óT 
(34) by F pus Ob, 
Do > bot obs. 


Then the resulting changes OX, in the terminal valves x; (T) 


are determined to be (for j = 1,2,3) 
3 Ky 


(35) Ok, = dis 7 JB ES au; .F*)at- i - (u, E De, 


+ je]. ôT 


2 Ki + 
em Us oom Us 
quss د‎ bb, 
e ke ο 
نا‎ E. 


P 


3 Ky " 
+ © 2 | ig va Sb, 
ΙΤ 
ad t 


ik 
where K, denotes the number of zeros of Us و‎ and Ud the cor- 


responding times. Equation (35) has the form 


(36) Oh, = 


€» E 
Hl 


aX; α a 5 

Xj 5T + ab: Sb, + ob: ea ον ٦ 
Setting oX; = AX, 

matrix defined by (36), we can determine the required changes 


and inverting the 'correcticn" 


87,6b,, 0b. to effect Xe. 


4 p + ٦ 
Jus ade, = Us sf. ST U 











Y A A‏ )<> سے۔ 
Y" aw‏ ! 


NA 


=” AS : 


di a 

— as 

- ین سج‎ ۰: vam αι κω”. 
u a 
U em oma 


-—— «Ὁ | u 

o سا‎ | 
—_ و‎ | κ.α m t 
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7, Derivation of Solution for N-th Order Systems. 
Let us consider a linear dynamic system of the AS order 
represented by the system of differential equations 
(e) X = AX + F 
where À is an n x n matrix with constant elements aik and 
With real and distinct eigenvalues. X 5 [x4 Xe .... اما‎ 
+0 ٥ fas. 
The system adjoint to (1) ean be written directly as 
E LU نر کر ےو‎ 
Biere U = [us Us .... ws We know from Appendix I that 


equation (2) has solutions of the form 


Es ve Lk, c 
j 


where -M. are eigenvalues of matrix Eu and the c? are the 
corresponding eigenvectors. 

Equation (3) can also be written in matrix form 
as 


k,e Mat 


(4) υ τς k,e Met 


9 
ο 


ΕΠ ° | 
where C is the n x n matrix composed of the eigenvectors CUL 
i.e., C 2 (C! C? .... C7] where the eigenvectors C aren x 1 
column matrices. 
If we choose a "special" solution U, s [u,, us, ο μαι, 
Ehe adjoint such that u4,(7T) = 1, us (T) = .... = uj, (1270, 


then equation (4) evaluated at t - T beccmes 
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Γον Usı(T) u. ο 


=-Mnt 
J 


u4 1 (T) πε " 


Up Wa 


Multiplying (5) through by C ^ we get 





kage I Can 
7ڑ ے‎ | 
(6) وو ا‎ 6 2 c^ | 0 is C21 
| 
=My T | ! 
| Eni? | 0 | boa | 
where the Cis are elements cf cul, 


Therefore, the constants Kel corresponding to solution 


U4 are determined to be as follows: 


ma Y 
kıı = 0316 - 

(7) leuc cts 
Kal . ey en 


so that, substituting (7) back into (4) we get 


e gli (1-0)‏ رات 
ugi(t)| ς - cle: ona Ev)‏ 
)8( 
mpg (T-t)‏ ! 
[n3 69] Mini?‏ 





Iherefcre, if in general we choose the "special" 

A ο, 1 ες 
solutions U. E Lu; لو لاء ورا‎ to the adjoint system 
such that u,,(T) = χε » [> ve 


O if j 


63 
0) 





we get 


u, C0 ae 

ug, C) N 5 nc E 
(9) 

(9. I 


So that, by grouping the n sets of solutions so obtained 


into a single matrix equation, we obtain 


mı (T-t 
U 11 u12 Un e 1 ( ) 0 9 e ο 0 
m.(T-t) 
U21 Uz2 Un) = c 0 e * 0 cl 
(10) , Lm 
ny (T-t) 
"M Une "nn 9 O _ 


oince the U. are independent soluticns to the adjoint 


U 


system, a linear combination U = U, + byUz +t ... + D |n? 


n-l 
where the b's are arbitrary ccnstants, is also a sclution. 
A solution obtained in this manner is called an adjoint 
vector. 


lÎ €5 €9,...,€, represent the base vectorsefor an 


n 
n-dimensional cartesian coordinate set, we can express the 
adjcint vecto as 


rU 
πι; U 5 L u, e. 


where 


a2) E Usa + b4U42 $ 60909 oo + PREU G = ου ας 


For a minimum-time path we choose F-F Such thet the 
components of ro satisfy the relation 


+ 
ms) f, = benu, a 77 


CÓ 
ο 





From the Fundamental Adjoint Formula we have 


1 
سر 


T 
TA 4 
14 M = j ο οἱ 
(14) [ L ux dlo JE ( L ii i? 


which, upon successive substitution of the "special" adjoint 


solutions U; reduces to 


x 1 


MS C 
as) xD = 7 u0) + de TERE 


HOS - 1,2,..,n. Equation (15) can also be written in 


٣۰٠٣٥٣٣ notaticn as 
T 


(16) x.) = XD +f ΜΉ: ο το... 
j 0+0 a. 
Again, as in the previous sections, we desire to drive 
the system from X(0) to X, in minimum time T. we therefore 
consider a linear combination of the xD, using the constants 


previously described in defining the adjoint vector. We have 


= mM 
| (5. Fhat 


“aO 


(17)  xi(T) * bixa(T) *...* b, Xx (1) = (U.K), + 


where U - DE 4 bat + Se +t Db uU 1S Re adjoint vector. 


Comparing the resulting terminal state X(T) with the 
desired terminal state Res we define the component errors 
as 


(18) ΔΑ. کچ‎ Air = x, (T) (3 = HOPES TD E 


If any Ax, 


input parameters required to effect X 


is not zero we must determine the changes in the 


que 





Suppose the initial values of the input parameters are 


replaced by nearby values 








۲ mule ST 

ba DA Sb; 
(19) : 

1 >b,_+ ÓD,_7> 


Then the cnanges Ok, resulting in the terminal valves x5 (1) 


Eu be expressed as (for j - 1,2,...,n) 


e 


1 


y E 
TIN er 80 tom 


ee 


Q : 


n 


hi + 
> Cu. | £25 GT 
2 z Us ta 


ici k=1 p 


n Ks + 
,. ۳٦ : 
+|y Yo [Ai Ue bb, 
aa , 
E ik 


+ 


n Ky 4 
ME. 
LL ujjlfi] Vin اٹ‎ 
j=l kzl ت7‎ a 
i ik 


Equation (20) has the form of the total differential 


ς = 84) §7 Sr; δ} 
(21) 6X, = ἘΠῚ + api obi + ..... + ob. Oni 
for (j=1,2,...,n). 
Setting AX; = ox, and inverting the "correction" 


matrix cefined by (21), we can determine the changes 


51, &bi,...., 6b, _, required to effect X,, if the rcutine 


converges. 





&. Conclusions and Comments. 

The solution of the minimum-time problem for second and 
third-orGer systems was programmed and run on the CDC-1604 
computer, using the Hhunge-hutta-Gill method of numerical 
integration to calculate the required integrals. It has a 
desirable feature that it is easy to vary the time intervals 
any time during a run. 

The ecnvergence of the differential-correction routine 
wm ars to be fairly critical, especially for stable systems, 
That is, if for a given set of input parameters the error 
Xp - X(T) is too large, the routine will not converge. 

The switching times t4, te for second-order systems were 
determined exactly, so that the degree of convergence was 
limited only by the degree of precision provided in the numerical 
integration (limited by the size of At) and cther rcutines. 
Convergence of the routine was obtained tc an accuracy of better 
than six decimal places (AR? - 10714), 

For the third-order systems the switching times were not 
determined exactly: if a component of the optimum forcing 
function changed sign in a time interval At, it was assumed to 
have changed sign at the end-point of the interval. In this 
®, convergence of the routine was limited to abcut three 
imal places (ARS Mor ف‎ for At = .005. Convergence to 
greater accuracy could be achieved by reducing the size of At 
πε numerical integration routine. 

Ihe method of solution appears to be applicable to more 
general problems. The case where the end-point Ar varies with 


pue I may be handled by incorporating into the correction 
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equations (7.18) a term invclving dXj/dT, as was dcne by 
Faulkner end wará [10] in a rocket trajectory problem. 

The solution curves have several interesting properties. 
As noted in section 5, if the solution fcr a second-order 
system has two switching times, the difference is a ccnstant 
of the system. A procf is given here that this is generally 
he cases 

Let us consider a linear dynamic system representec by 
the system of differential equations 

(1) X = AX + F, 


which can be written in expanded form as 


o 


X 
(2) : 
y = ex*üdy*g le | 


ax + by +f Tl C1 


L^ 


IA 


a 
where the elements a,b,c,d are constants, and the eigenvalues 
oe A are real and distinct. 


the eigenvalues cf matrix A (rcots of the characteristic 


equation |A - mI| = 0 ) are 
EE D sepa ded + یھ‎ He ee 
E 2 
where 


(4) r = (a-d)? + 4be ο 


The "special" solutions Uy, Us (described in earlier 
sections) of the system adjoint to (1) can be expressed jointly 
in the following matrix equation: 


(5) LU, Ua J] = üi uo = G ei (I-t) Q ο, 
¿M2 (T-t) 


9 
Va Vo 9 


where C is the matrix of eigenvectors cf -at, 
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Ihe general scluticn U - U, + kU, of the adjoint system 


can then be expressed as 


(6) vu =ful=fu uglfi] ger ο EINE 
V = Vo | lek | 0 Mz (1-4) k 


Let t4,t2 dencte the switching times of f and g respectively, 
νο. ult,) = vita) = O. 

Solving for C and C^? by the methods described in 
mopendices 1 and 11, we obtain the following expression for 


u and v evaluated at t} and ta respectively: 


z 
N EO e" (T-t9 [amdtp szkol + el2(T-W um d 
۱ au er 
i | (T-t) |2b+k( ) (T-t,) |-2b+k (a-d+r) 
5 mn \ebtk( -at+tatr Mal Y-to)|-2b+k(a-d+r] 
v(te) =O=e i = | +E | 55 | 


À simplification cf equations (7) can be made by using the 
relation r = mı = Mọ. The reduced form is then 


( or (T-t1) . 8-0 *2kc -r 
a = aT 2ke FT 
(8) 
E _ eb = kr - κ(α-ᾷ) 
-. Ab + kr - k(a-0d) 


ê now consider the ratio 


E n ے‎ gr(ta-ti) . acdteke-r , 2btkr-k(a-¢d) 
ο a-d*ekc4r ' £b-kr-k(a-d) 


which can be reduced to 
r(te-t;) . 2 (a-d -r). b - k(a-d) - k?c 
EU C رٹ جو ہہ‎ PES Ee ; 
we obtain the folloving relation between t, and ts: 


Q1) testa = > does [FES FE) 


that is, the difference between the switching times t, and te 
on a minimum-time trajectory is an invarient cf the cynamic 


24 دہ‎ 
Sys ven © 
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Un the other hand, switching curves or surfaces, which 
have received much ettention, seem to have no particular 
significance. they are not implicit in the differential 
egvaticns, but depend on the particular prcblem. Typical 
switching curves are given in Illustration 2 for the case 
where the trajectcry begins at the origin. In the same figure, 
the dotted lines incicate the boundaries to the points of 
Stable stability. 

the concept of using the adjoint system to calculate 
Cifferentials of end values is apparently due to Bliss in 
his work in ballistics [£]. In the problems solved here, 
an explicit soluticn to the adjoint system was obtained, 


which made possible the integral formulas for the end-point X(T). 
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AP] ENDIX I 


Solution cf a System of Homogeneous Linear First-Order 
Γι. σος mouavicns with Constant Coefficients. 
Suppose we have the differential equaticn 


209 7 Ὁ 


"ere Busan"n'"xuon matrix with constant elements bij, 


and with real, distinct eigenvalues. 
Let us assume a solution of (1) of the form 
(2. ۶ 7۶۳۲ 
where C is ann x 1 column matrix with constant elements. 
Differentiating (2) with respect to t, we get 
(3)  U - me"* c, 
Ei@ecitution Of (3) and (2) into (1) gives the following 
result: 
(4) Meere: s ac 
and, since al; is a scalar quantity appearing cn both 
sides of (4), we have 
(5) πο Er ٠٦ 
Therefore, if m is an eigenvalue of matrix B, then C 
must be a correspcnding eigenvector. since there exist n 
۲۰۶٦٠٦٢٠٢ Cigenvalues My, Me, ..--5 My Of matrix B, there 
are n independent solutions cf (1) of the form? 
(6) vi = toi (j = 1,2,...,2) 
E 


where C = Lez; Sa u ie is the eigenvector corres- 


nj 
ponding to eigenvalue SL and Ud = [uj už ους us je 


ws In this section only, ma is associated with scluticns 
mer U. 





The general melution*or (1) is then a linear combination 
C1 the us, DOCS 


(7) U = Lk. Ue -» 2, k,eP3* c) 
DE ied 


where the EE are arbitrary constants. 


Componentwise, (7) may be written as 


E mat : 
ES E == L E J Cii (i = Veran 





L APPENDIX II 
Determination of the Components of Higenvector οὖ. 

ve have the adjcint system of cifferential equaticns 

G w Pa 

where a is an n x n matrix with constant elements asi and 
Mata Ea di tinct eigenvalues., 

From Appendix I we know that the scluticn of (1) is 
of the form 


(2) puc M XD ο 
y w 


where the -m; are the eigenvalues of matrix ES and the C" 
are the corresponding eigenvectors of A. The κ. are 
arbitrary constants; 


Differentiating (2) with respect to t we get 


(3) ου. οσο 
- υ 3 
J 
The e component of (3) can be written as 
(4) Us = x mal. ¿mt Sen (i = 09-2۹۶۹ DE 
J 
: ΜΟΙ ۱ 
we can also write the i component of (1) as 
(5) Us = = aT = 454 U5 ۶ 1:۶ . e و ما و ہ8‎ (απ νου. 
The e ccmponent cf (2) can likewise be written 
as 
(6) wus Lx, ΠΠ ο) (1 - 1.2 ΝΠ 
J 


. Substituting (6) into (5) we get 


> — _ -m-t 9 me -mst 
74 m a7, ( Lk J ο] 1) ao; l re Coj) ΗΝ... 


Ην 






û mi © e "-— M1 

- - 8 (o? دہ‎ - | 
= mer Zi” yw ΤΟ α΄. 
«Ὁ ὦ ο. ιν 


mx اس‎ 


JM ήν 
"7" E S 




















Since (4) and (7) represent equivalent expressions cf 


the Us we can equate the corresponding cocfficients of 


à -mjt x ہیں‎ ER: 
the k;e mJ". For example, equating the correspencine 
e =114 € 
coeficientes oo kie >” we get 
(5) تد‎ Da en ze a πο + 7٤0 πα 


Inerefore, vrıtine Gul all n of the +۷۷۷۷۶١۷۹۷٦٦۳٦ 


: : E “YN 4 t 
equating ccrresponding coefficients of k,e +” we get 
“MgCaa 7 =211C11 7 891€21 7 55. * Snıcnı 
T-4C24 — -832C31 7 822C€21 7 oe... - AngCna 
(9) 
-MıCnı 7 -24nC€11 - ΒΡΩΟΦΙ - ουοουο = apneni 


which can be written es the following matrix equation: 





84 4 *Il4 a23 ani C11 0 
212 222 My an2 ο. O 
(10) B 
| | 
-m ο | 0 
lı aan aan Ann 1] ni DA 


Denote by A the determinant of coefficients in (10). 

Perm 2 NChtravial sclution of the cy, ic exist it is necessary 
that A = O, i.e., that 
ΠΠ, αντ ςο, 

ΙΟ ٣۴٣٦ consists of the ccfactors ct the 
elements of a row of the matrix Ux m1I], see Bellman [ 6 ]. 
This is the same as the cofactors of a column of [A - m,I]. 
That is, the components of eigenvector C? are in the same 
ratio as the cofactors of the elements of a column of the 


παπι ο ۲ ο matrix DÀ = miij. 
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Similarly, the components of the remaining eigenvectors 
CY can be found by using successively the ccfactcrs cf the 


elements of a column of the matrices [A - mI]. 





Computer Flow Chart fcr Soluticn cf N 
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Find eigenvalues m; of A 
(cots of Charaeterdst MEA). 


Form eigenvectors C! of -A’. 
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> 
Illustration = ` Switching Curves and Minimum-Time Trajectories 
for 
Ως Stable System 
ی‎ — | -1 1! 
Br 


Pg 


switching Curves: 
OP, ,OPs g switches 


OG Qo f switches 


Region of Static Stability 
bounzed by dashed lines. 
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SPECIAL SYMBOLS AND NUTATICA 


Symbol 


A = | X4 Xo eo MI: 


A = Σ Xe, 
R = ze m ye o 
— T a 
PF E iem fo eo rod 
F = Σ Pie, 
E T 
U =. Lua Ue o 9 uJ 
U = Σ رتا‎ 6 E : bl 
(bo Ξ 1) 
us= (u? uJ 3T Tm 
JE 
U; Lu, y 23 + Up 3] 


cil 
I! 
M 
ο 


Q 
es 
J 
en 
© 
fa 
ca. 
Ω 
eo 
e. 
O 
= 
es 


BE [ο ο... cH] 


(Orr) = : uif. 


198230»... 


n 
À 7 (ag) 
B= (bi 
LA - mI] 
= mT] 
|A - mi| = 0 


Meaning 


o د‎ ο nn A ΙΙ” سر‎ 


TI οὗ coordinates al- -cmo TEE 
System state function. 


came, considered as a vector. 


same, considered as a vector. 
ἔπ Τ.Ε) function. 


pame, considere as a vector. 


Solution to adjoint system of 
differentiai equaticns. 


Adjoint vector 


xb : end 
d 0ی‎ of adjoint system 
corresponding to eigenvalue u: 


zen "special" adjcint scluiion 


such that ἃς CT) = S4) = زع یا‎ 
-- , f a 
Ον. 

came, ccnsidered as a vecltcr. 


ni 
گے ٭‎ ΤΕ RE و"‎ 
Ligenvector of -À corresponding 
to eigenvalue -m,. 

i 1 
Matrix of eigenvectors cf -A' . 


ocalar product cf adjoint vector 
and forcing vector. 


Base vectors of Cartesian ccordinate 
set in n-space. 


N KN Mall GE coefficients. 
ITM CTI οἱ ccei ficients, 
Gieteaeveristic matrix cf 4, 


Coatacteristic matrix of A 
associated with eigenvalue En 


Characteristic equation cf A. 


3 


DO 





Symbol مر‎ 701, 57 


f ; ۱ POEM 
0 Diagcnal matrix with i diagonal 
ms(L=t 
element e j ) 
xX (0) = (X13X23°9Xn)o Initial state of Cynemic system 


Ae = (XipsXopsecsAup) lerminal state of cynamic system 
(specified) 


Be) = (X44,Xp,-..,X.)4 lerminal state cf dynamic system 
ΠΗ : 
at time t - T. 


T Terminal value of time; also 
transpose when used with matrix. 


I oubscript f denotes final value. 


Bar over a symbol indicates tnat 
it is a vector. 





ο); Element of Ci, 
ΔΑ. = Kir = x; (T) ۰ظط‎ ٣٣٣۰٠۰٠۰٠٠٠٠٠٦٣١: 01817.106 cf zen 
component, 
ہے‎ Ε 
T = (U.F ), t Stt, au 
b = Cai DA; DA; 
Ok; = Sq 91 * gp a 
nel 
L 1, Jump disccntinuity in veriable 
ik at time t. 
ik 
(U..[F]) = (U,.F) - (U,.F) - -- 
J tik j نت‎ j TO O tik 
t Ken switching ti ff 
ik swi ing time ο 1" 
O ہے امھ‎ ke 




















